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Thp  primary  purpose  of  the  present  study  was  to  replieate  an 
esperimenl  previously  conducted  by  Baldwin  and  Bailey  (1971)  in  order 
to  establish  the  reproducibility  of  their  results  in  a  different  user 
environment.  Twelve  psychometric  instruments  employing  technical 
training  materials  which  required  various  type.n  of  visual  skills  were 
used  in  the  teslirg.  Three  forms  of  each  test  cxercis^i!  were 
reproduced;  hardcopy.  positive>image  mii  rnfiche.  and  negative* 
image  microfiche..  Ninety  subjects  were  randomly  assigned  to  one  of 
three  experimental  groups  (hardcopy,  positive-image,  and  negative- 
image).  An  analysis  of  variance  (Winer.  1962;  Myers.  1966)  revealed 
F  values  to  be  significant  beyond  the  .01  level  for  Test  4.  Figure 
Identification;  Test  6,  Symbol  Translation:  Test  7.  Graphs;  Test  8. 
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Test  5.  Length  Estimation.  No  significant  differences  in  performance 
were  found  between  positive  and  negative- image  microfiche  presenta¬ 
tions.  These  results  generally  substantiate  those  reported  by  Baldwin 
and  Bailey.  Further  analyses  demonstrated  that  the  reader  presenta¬ 
tion  primarily  affected  the  speed  at  w*hich  the  subjects  worked  while 
accuracy  was  not  rliffcrcntially  affected  by  the  presentation  mode.  An 
analysis  of  the  perforrr.r.nce  of  subjects  grouped  according  to  Armed 
Forces  QuaLfication  Test  (AFQT)  scores  indicated  that  various  intel¬ 
ligence  groups  were  differentially  affected  by  the  mode  of  presentation. 
Vtliile  statistical  differences  were  found  in  a  number  of  test  exercises, 
no  fundamental  difficulties  were  encountered  which  would  bar  future 
utilixatf^n  of  microform  materials  in  technical  training  programs. 
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Drn'tce'r  S^rscArch  tllnivor*»ly  of  Denver.  A  Per^ttrwAnte 

iC^'AlualSonr.  Mic  rofiche  ver«u»  tlAfdcopy„  AFUR 
Lowry  AF li*  Colo.;  Technical  Training  Diviiiion,  Air  Force 
Human  Resource*  Laboratory,  May  19TI. 

Objeclivc* 

The  primary  objeclive*  of  ihi*  study  were  (a)  to  replicate  an 
experiment  conducted  by  Baldwin  and  Dailey  In  19TI  to  establish  the 
reproducibility  of  their  results  in  a  different  user  envirot merDi,  and 
(b)  to  cssiablish  the  reliability  of  instrument*  which  they  developed 
as  tools  ior  use  in  future  Air  Force  microllchc  evaluations. 

Approach 

Three  forms  (hardcopy,  positive-image  microfiche,  and 
negative- image  microfiche)  of  twelve  psychometric  instruments 
employing  technical  training  materials  were  developed  for  this  study. 
C^incty  Air  Force  trainees  were  randomly  assigned  to  one  of  three 
experimental  groups  (hardcopy,  positive-image  and  negative- image)  &rDd 
pcrformanco  comparisons  were  e.*aluatcd  In  terms  of  the  study 
objectives . 

Findings 

major  findings  in  terms  of  the  replicative  aspects  of  the 

study  wer^: 

1.  Baldwin  and  Bailey's  finding  of  no  significant  difference  in 
perfbrmance.  using  narrative -type  materials,  among  any  of  the  pre- 
seniJlton  modes  was  confirmed  in  terms  of  the  overall  experimental 
rest!  IIS. 


2.  The  original  finding  of  no  significant  difference  in  perfor- 
manr:e  across  all  instruments  for  the  positive  versus  the  negative 
microfiche  presentations  v^as  also  confirmed. 

3.  Significant  differences  between  fiche  and  hardcopy  perfor- 
marre  for  three  of  the  nine  non-narrative,  visual  discrimination  instru- 
merA4  were  encounterc-^  in  both  studies,  but  three  additional  instruments 


V 


also  showed  significant  performance  differences  between  hardcopy  and 
one  or  both  of  the  fiche  presentations  in  the  present  study. 

In  general,  then,  the  Baldwin  and  Bailey  results  were  replicated; 
their  main  results  could  be  extended  to  a  different  environment,  a 
different  time,  and  to  different  equipment.  Further  analyses  resulted 
in  two  additional  findings: 

1.  The  microform  presentation  primarily  affected  the  speed  at 
which  the  subjects  worked  while  accuracy  was  not  differentially  affected 
by  the  presentation. 

2.  An  analysis  of  the  performance  of  subjects  grouped  accord¬ 
ing  to  AFQT  scores  indicated  that  various  intelligence  troups  were 
differentially  affected  by  the  mode  of  presentation. 

This  summary  was  prepared  by  Dr.  Edgar  A.  Smith,  Technical 
Training  Division,  Air  Force  Human  Resources  Laboratory  . 
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PERFORMANCE  EVALUATION;  MICROFICHE 
VERSUS  HARDCOPY 


I.  INTRODUCTION 

Microforms  have  long  been  used  in  industry  and  governm  it  as 
a  storage  and  retrieval  tool  having  enormous  administrative  value  ind 
varying  user  value.*  In  educational  environments,  however,  micro¬ 
forms  (although  now  widely  distributed)  reflect  primarily  an  adminis¬ 
trative  solution  to  the  problems  of  acquiring  and  storing  specialized 
materials.  This  results  in  a  limited  number  of  applications  and, 
therefore,  a  limited  user  group.  The  ability  of  individuals  to  effec¬ 
tively  use  microform  training  materials  must  be  examined  before 
educational  applications  can  be  expanded  from  their  substitution  for 
hardcopy  to  their  routine  utilization  as  a  new  communication  medium. 

Experimental  studies  are  needed  which  consider  the  question, 
"To  what  extent  are  the  cognitive  skill  levels  of  students  preserved 
when  using  a  microform  presentation?"  In  one  such  study, 

Kottenstette  (1969)  determined  in  a  reading  experiment  that  there  are 
no  fundamental  physical  or  psychological  barriers  to  the  utilization  of 
microforms  in  the  communication  of  narrative  information  that  the 
student  customarily  encounters  in  hardcopy.  Students  are  able  to 
preserve  skill  levels  (reading  rate  and  comprehension)  when  utilizing 
reader  presentations  of  both  descriptive  and  abstract  narrative  mate¬ 
rials  which  reflect  various  levels  of  difficulty. 


*  The  term  microform,  as  employed  in  this  repcrt,  is  intended  tt' 
include  microfiche,  ultrafiche,  ultra- reduced  microcopy  and  piioto- 
chromatlc  images.  The  COSATI  standard  nucrofiche  form  was  used 
in  this  study. 
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Baldwin  and  Bailey  (1971)  also  found  that,  for  narrative 
reading  at  least,  students  could  perform  adequately  using  microfilmed 
materials.  These  investigators  conducted  an  extensive  and  thorough 
review  of  the  technical  training  materials  used  at  (he  Chanute  Technical 
Training  Center,  Chanute  Air  Force  Basei  Illinois.  After  consulting 
with  a  number  of  experienced  training  specialists,  they  developed 
twelve  tests  which  represent  the  various  visual  skills  involved  in  the 
utilization  of  these  materials.  Thpee  forms  of  each  test  master  were 

I 

reproduced  (hardcopy,  pos itive- image  microficljie,  and  negative- 
image  microfiche)  and  presented  to  three  separate  trainee  groups. 

The  experimental  results  indicated  statistically  significant  differences 
favoring  the  hardcopy  presehtation  for  three  of  the  twelve  tests.  All  of 
the  significant  differences  were  encountered  in  tests  which  involved 
character  recognition  and  symbol  interpretation  as  opposed  to  reading 
continuous  prose.  The  authors  concluded  that,  in  terms  of 
"readability,  "  materials  presented  via,  microfiche  are  feasible  for 
future  technical  training  purposes.  , 

"Readability,  "  as  conventionally  used  in  relation  to  hardcopy, 
has  been  defined  in  terms  of  the  difficulty  or  complexity  of  the  content 
of  the  material.  Applying  this  definition,  more  readable  (easier,  less 
complex)  uiaterial  is  likely  to  result  in  greater  understanding,  learn¬ 
ing,  and  retention  than  less  readabU;  (more  difficult,  more  complex) 
material  (Klare,  196  5).  When  hardcopy  materials  are  transferred  to 
microfiche,  a  somewhat  different  definition  is  employed  which  can 
best  be  understood  in  teri'is  of  the  distinction  made  by  Kottenstette  (1  969) 
between  i;eadabi  1 1 1 y  and  visibility.  ' 

It  should  be  emphasized  that  the  tests  developed  were  not  designed 
to  represent  technual  tra  ning  content  areas  but  ratht^r  visual  skills. 
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Some  of  the  image  quality  of  the  hardcopy  is  lost  in  the  transfer 
to  microfiche,  both  in  the  photographic  reduction  process  and  in  the 
reader  magnification  process.  A  substantial  loss  of  image  quality  can 
be  tolerated  with  little  effect  on  t^ie  user's  reading  skills  when 
readability  depends  on  the  recognition  of  complete  words  or  groups  of 
words  in  context,  as  in  nar rative  materials .  However,  with  materials 
which,  by  their  nature,  content,  or  purpose  are  dependent  upon  individ¬ 
ual  character  recognition,  or  vi sibility,  the  reduced  image  quality  may 
affect  cognitive  skill  levels. 

The  distinction  made  here  between  readability  and  vis ibility  is 
important  because  the  tests  developed  by  Baldwin  and  Bailey  focused 
on  the  visual  skills  utilized  in  training,  not  on  the  content  of  the  mate¬ 
rials  encountered.  This  suggests  that  the  successful  completion  of 
many  of  the  test  exercises  was  more  dependent  upon  visibility  than 
upon  readability,  as  these  terms  are  last  defined  above.  However,  in 
some  cases,  the  exercises  involved  more  than  a  simple  visual  dis¬ 
crimination  task;  in  order  to  complete  the  exercise,  the  subjects  were 
required  to  assimilate,  process,  and  use  that  which  was  discriminated. 
In  this  way,  the  term  "readability"  v/as  expanded  in  the  Baldwin 
and  Bailey  study  to  include  the  interpretation  and  coding  skills  as  well 
as  the  visual  discrimination  skills  involved  in  dealing  with  schematics, 
wiring  diagrams,  flow  charts,  tables,  graphs,  and  three-dimensional 
drawings . 

Purpose  of  Study 

The  present  study  is  part  of  a  larger  research  effort  designed 
to  develop  and  evaluate  microforms  for  use  as  primary  source  niate- 
rials  in  Air  Force  tecl.nical  training  programs.  Data  from  three 
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investigations  will  be  analyzed  and  reported  separately  in  response 
to  the  following  questions; 

(1)  Can  Air  Force  trainees  use  microform  presentations  of 
educational  and  training  materials  to  an  extent  consistent  with  their 
use  of  hardcopy  materials? 

(2)  What  are  the  optimal  microform  formats  to  be  used  in 
presenting  technical  training  materials? 

(3)  What  are  the  costs,  advantages,  and  disadvantages  of 
microform  presentations  in  actual  classroom  use? 

In  addition,  a  user-oriented  guide  to  the  utilization  of  micro¬ 
form  technology  in  technical  training  will  be  prepared,  based  on  a 
review  of  the  literature  and  the  insights  which  result  from  the 
research  effort. 

The  research  reported  here  addresses  the  first  of  the  questions 
enumerated  above.  It  was  designed  primarily  to  replicate  the  experi¬ 
ment  conducted  by  Baldwin  and  Bailey  in  order  to  establish  the 
reproducibility  of  their  results  in  a  different  user  environment,  and  to 
establish  the  reliability  of  instruments  which  they  developed  as  tools 
for  use  in  future  Air  Force  microfiche  evaluations.  This  study  had  the 
secondary  purposes  of  providing  insights  into  the  strengths  and  weak¬ 
nesses  of  microform  presentations  in  an  operational  sense,  as  well  as 
generating  criteria  for  evaluating  the  psychological  or  training  implica¬ 
tions  of  using  microforms  as  primary  source  materials  in  technical 
training, 
o  theses 

Two  hypothese.s  were  de\eloped  to  help  meet  the  primary 
research  objective.  The  first  stated  that  (1)  students  using  the  hard¬ 
copy  presentation  would  perform  significantly  better  than  students  using 
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either  the  positive- image  o£  the  negative- image  microfiche  presenta¬ 
tions.  This  hypothesis  was  based  on  Baldwin  and  Bailey's  finding  that 
when  the  method  of  presentation  affects  the  "readability"  of  material, 
the  advantage  favors  the  hardcopy  presentation.  The  second  hypothesis 
stated  that  (2)  there  would  be  no  significant  performance  difference 
between  subjects  using  positive-image  microfiche  and  subjects  using 
negative- image  microfiche.  The  second  hypothesis  was  stated  in  a 
non-directional  form  because  the  question  of  film  polarity  had  not  been 
adequately  resolved  before  the  present  study  was  conducted. 

Baldwin  and  Bailey  encountered  enormous  variance  in  their 
data  suggesting  that  a  stratification  of  the  subjects  based  on  an  intel¬ 
ligence  index  might  prove  valuable.  It  appeared  possible  that  highly 
intelligent  subjects  would  respond  to  the  machine  presentation  with 
increased  or  decreased  sensitivity  as  compared  with  less  intelligent 
subjects.  An  additional  hypothesis,  therefore,  stated  that  (3)  subjects 
divided  into  high,  medium,  and  low  intellectual  groups  would  be  dif¬ 
ferentially  affected  by  the  presentation  mode. 
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II.  METHOD 


Psychnnu;tric  Instruments 

The  test  exercises  used  in  this  study  were  developed  by  Baldwin 
and  Bailey  and  required  many  of  the  types  of  visual  skills  used  in  Air 
Force  te-  hnical  t'aining  programs.  Performance  requirements 
included:  the  reading  of  continuous  prose  and  shortparagraphs ;  reading 
schematics,  wiring  diagrams,  and  flow  charts;  identifying  and  dis¬ 
criminating  prec  ise  figures  and  symbols;  and  reading  charts,  tables, 
graphs,  and  three-dimensional  drawings. 

Several  of  tht^se  test  instruments  were  reproduced  or  adapted 
from  the  Kit  of  Reference  Tests  for  Cognitive  Factors,  copyrighted  by 
the  Educational  Testing  Service,  Princeton,  New  Jersey,  and  developed 
under  Office  of  Naval  Research  Contract  Nonr-2214(00),  Project 
Designation  NR-  151-  174  (1963).  Reproduction  of  these  test  instruments 
is  permitted  by  and  for  United  States  Government  use. 

The  following  paragraphs  contain  a  short  description  of  each 
test  exercise.  The  time  limits  presented  were  taken  from  Baldwin  and 
Bailey  who  established  them  at  two  standard  deviations  above  the  mean 
time  for  completion  of  one-half  of  the  test  (based  on  pretest  data; 

N  =  42).  All  tests  were  scored  by  counting  the  number  of  correct 
responses  for  each  test  exercise.  The  test  instructions  and  sample 
items  of  each  test  are  included  as  Appendix  A. 

Tests  1  and  2,  Narrative-Continuous  Prose.  Material  for  this 
section  was  selected  from  the  survival  training  text  of  the  ATC  Student 
SUidy  Guide  O/R  1S15A.  The  content  was  rewritten  as  continuous, 
uninter rupted  prose  and  modified  by  deleting  three  key  words  on  each 
page  and  r.-placing  them  with  blanks.  The  tasK  was  to  read  the 
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material  and  supply  the  missing  words  (Part  I  50  minutes;  Part  II 
25  minutes). 

Test  5,  Narrative-Short  Paragraph.  The  same  type  of  mate¬ 
rial  as  used  in  the  continuous  prose  exercises  was  used  in  this  test; 
one-hundred  paragraphs,  two  or  three  sentences  in  length,  were 
isolated  from  the  text  and  modified  by  changing  one  word  in  each  para¬ 
graph  to  be  inconsistent  with  the  meaning  of  that  paragraph.  The 
subjects  were  required  to  read  the  paragraph  and  identify  the  incon¬ 
sistent  word  (25  minutes). 

Test  4,  Figure  Identification.  For  each  item,  the  subjects 
indicated  which  of  five  geometrical  figures  or  pictures  in  a  row  was 
identical  to  a  figure  presented  at  the  left  of  the  row  (5  minutes). 

Test  5,  Length  Estimation.  Each  item  consisted  of  two  points 
connected  by  three  curved  or  angular  lines.  The  task  of  the  subjects 
was  to  select  the  shortest  of  the  lines  (3  minutes). 

Test  6,  Symbol  Translation.  This  was  a  test  of  the  subjects' 
ability  to  translate  symbols  into  alphabetic  characters.  A  legend 
presented  alphabetic  letters  and  their  corresponding  symbols.  Each 
item  consisted  of  a  short  series  of  syrr;hols;  the  subjects  were  required 
to  identify  the  alphabetic  characters  which  corresponded  to  each 
symbol  (10  minutes). 

Test  7,  Graphs .  Four  curves  on  a  graph  plotted  the  relation¬ 
ship  of  temperature  to  time  (in  minutes)  under  certain  experimental 
conditions.  For  each  test  item,  the  minutes  were  given.  The  task  was 
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to  indicate  the  temperature  which  corresponded  to  the  giv'en  number  of 
minutes  for  each  curve  (7  minutes). 

Test  8,  T ables .  A  table  was  presented  which  contained  drill -bit 
sizes  and  their  corresponding  decimal  equivalents.  The  task  was  to 
refer  to  the  table  and  indicate  the  decimal  equivalertt  for  each  of  the 
given  drill-bit  sizes  (4  minutes). 

Test  9i  Mechanical  Drawing.  Subjects  were  required  to  locate 
lines  and  surfaces  on  three  separate  views  of  an  object  (front,  side, 
and  top)  corresponding  to  lines  and  surfaces  on  a  three-dimensional 
view  of  the  same  object  (5  minutes). 

Test  10,  Schematics ■  An  item  consisted  of  a  network  of  lines 
as  in  an  electrical -cur rent  diagram  which  has  many  intersecting  and 
intermeshing  wires  and  five  sets  of  terminals,  each  marked  S  (start) 
and  F  (finish).  The  task  was  to  follow  the  lines  and  to  determine 
through  which  pair  of  terminals  there  was  a  complete  circuit  from  S, 
through  a  circle  at  the  top  of  the  diagram,  to  F  (15  minutes). 

Test  11,  Flow  Diagrams.  The  subjects  were  presented  with 
diagramatic  sections  representing  city  maps  with  the  streets  blocked 
at  various  points  by  barriers.  They  were  required  to  select  the 
shortest  path  between  two  points  so  that  no  roadblocks  need  be  crossed 
(7  minutes). 

Test  I  Z,  Number  \"e  rification.  The  subjects  inspected  pairs  of 
niulti-digit  numbers  and  indii  ated  whether  the  two  sets  of  numbers 
differed  or  were  identical  (6  minutes) 
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Baldwin  and  Bailey  determined  the  reliability  of  each  test  using 
the  following  procedure:  One-half  of  each  test  was  administered  on 
successive  days  to  a  sample  of  42  subjects,  using  only  the  hardcopy 
presentation.  After  test  reliabilities  were  computed,  the  Spearman- 
Brown  prophecy  formula  was  used  to  estimate  reliabilities  for  the  total 
test  length.  Results  of  the  analysis  are  presented  in  Table  I  and 
indicate  that,  in  general,  the  reliabilities  are  within  a  range  acceptable 
for  making  comparisons  among  treatment  groups.  A  possible  exception 
is  Test  11,  Flow  Diagrams,  which  has  a  reliability  of  .  59-  It  would  be 
necessary  to  increase  this  exercise  to  2.78  times  its  present  length  *o 
achieve  a  reliability  of  .  80.  The  remaining  eleven  tests  have  reliabili¬ 
ties  ranging  from  .  76  to  .  93. 

Table  I.  Reliability  Coefficients 
N  =  42 

Test  No.  ’*xx 


1. 

Narrative  (50  minutes) 

.  92 

2. 

Narrative  (25  minutes) 

.  85 

3. 

Narrative  -  Short  Paragraph 

.  79 

4. 

Figure  Identification 

.  90 

5. 

Length  Estimation 

.  90 

6. 

Symbol  Translation 

.  79 

7. 

Graphs 

.  93 

8. 

Tables 

.  76 

9. 

Methanical  Drawing 

.  90 

10. 

Schematics 

.  88 

1  1 . 

Flow  Dia.grams 

.  59 

12. 

Number  Verification 

.  91 
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The  ((•'SI  nmatcpraK  prcfiared  hf  Biticllwin  iiind  BAilcy  were*  used  So 
r<v|smilliijicc  the  Icwliiniit  UniiiriumcntM  used  Hn  iHis  cxpr>rlimvnl»  B  should  he 
rrKpha!<iiijted  shAl  the  sante  masters  were  used  to  produce  the  hardcopy 
and  So  tlhn  the  posit H‘'e^tma|cc  and  negative^ image  fnicrofiche  forms.. 
Kgliuipmeni  and  Tesling  Environment 

Th^  reader  used  in  this  study*  the  Eastman  Kodak  Recordak 
Kasamat.ic  Reader.  J*!!odcl  PFCD*  is  a  tabletop*  film  reader 
designed  specifically  for  viewing  images  on  4*  by  6>inch  microfiche 
having  DOD,  NMA  or  COSATf  formats.  The  readers  could  accom> 
modase  both  posilive^and  negative^l  nage  microfiche. 

The  exporintent  was  conducted  at  the  Human  Resources  Labo^ 
ratory.  Lowry  Air  Force  Base*  Colorado.  A  large  room  was  provided 
and  equipped  with  six  30^  by  54«inch  tables.  Four  tables  were  used  to 
accommodate  microfiche  readers  and  the  remaining  two  were  used  for 
hardcopy  work. 

The  ambient  illur'tinalion  level  normally  varied  from  approxi^ 
matcly  40  fool-candela  to  50  foot-candela  over  the  duration  of  the  daily 
experimen  i:!  period.  The  variation*  due  to  sun  position,  was  well 
within  the  comfort  range  for  reading  offset  copy.  The  overall  environ¬ 
ment  was  typical  of  an  office  selling. 

5ubj^^cts 

Experimenlai  subjects  were  obtained  from  Air  Force  technical 
training  lude?  Is  or  Personnel  Awaiting  Training  Status  (PATS)  at 
Lowry  Air  Force  Base*  Colorado.  All  scobjccls  were  high  ^^chool 
graduates:  none  held  college  degrees*  although  some  had  limited 
college  -experience..  To  lest  the  hypothesis  of  no  difference  among 
i!3ie  sub];«“c!  disf  rihull  ions  in  the  three  treatment  groups  used,  a 
chi'  •  re  ir-st  using  the  Armed  Forces  Qualification  Test  (A.FQT| 
su  fufes  «  .as  «  omputed. 
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The  AFOT  i'-ocabyiBAry,  ttrulhnielir  d^iri 

wpdtiiaaS  relttlinniihip  prtibBent!*.  (he  liftiil^naittud  irttoH  mjit  ihe 
pert-'topn btn*  fiianipul^l'iion.  and  anal^’Nisn  of'  rt'laiiona  an  two  and  xbree 
dijrsirnsiioni  {UhJantT,  Itvioa  wi»rr»  ftefecled  on  fho  ba?siti.«  of  dai- 

ffcutly  Suvei  as  well  as  on  the  basis  of  their  eur relations  w«tb  svabtc'sta. 
and  the  total  test  scores. 

The  resultant  chi  square  value  of  9.HJ5  for  IS  dejigrtc*  of  fr«'^c 
dom  was  not  siitnificant  (p  >  .'SO),  and  indicated  that  therr  werK*  no 
siitnificant  differences  a-^vong  the  three  groups  in  terms  of  AFOT 
scores. 

Testing  Procedures 

Ninety  subjects  were  tested,  30  in  each  of  the  three  ireatmeni; 
groups.'*'  All  subjects  were  airnten  awaiting  training  at  the  Lowry 
Technical  Training  Center,  l.owry  Air  Force  lUisc,  Coloratb',  Ihe 
subjects  were  assigned  in  a  quasi-random  manner  to  testing  posifnon'^ 
resulting  in  two  subjects  for  each  of  the  three  irealmenl  groups  each 
saon.  All  test  instruments  were  administered  by  the  same  "»nvrsl igat t  :• 
using  slandardi/.e(f  test  procedures  and  instructions.  The  total  lest 
battery  .°cquircd  approximately  four  hours  to  complete.  Forty  mirntt^ 
of  this  lime,  hou.'cvcr,  was  devoted  to  breaks:  two  ten- minute  breaks 
and  one  iv/enly-minule  break  each  day.  The  order  of  presenlali  -  j  wa; 
counierba! ';;iced  to  dislribulc  possible  practice  anr!  fatigue  clfects 
equally  over  all  conditions.  That  is.  the  instruments  w“cre  administered 
in  fifteen  different  sequences  within  each  group,  one  for  each  test  day 
The  orders  of  presentation  are  presented  in  Appendix  B. 


^  94  students  were  actually  run:  four  subjects  were  eliminated 
because  they  were  unable  to  complete  the  entire  test  sequence. 


III.  RESULTS 


The  primary  purpose  of  this  study  was  to  replicate  a  previous 
experiment  (Baldwin  and  Bailey)  to  determine  the  effect  of  three  dif¬ 
ferent  methods  of  presentation  on  the  ability  of  subjects  to  process 
se\eral  types  of  information  through  the  visual  modality.  As  in  the 
original  experiment,  separate  analyses  of  variance  were  computed  for 
each  of  the  twel\e  test  exercises. 

The  results  of  the  single  classification  analyses  of  variance  are 
presented  in  Table  II.  F  values  for  the  test  exercises  were  found  to  be 
significant  beyond  the  .01  level  for  Test  4,  Figure  Identification;  Test  6, 
.Symbol  Translation:  Test  7,  Graj)hs;  Test  8,  Tables;  and  Test  12,  Num¬ 
ber  Verification:  and  beyond  the  .05  level  for  Test  5,  Length  Estimation. 
(These  exercises  include  Tests  4,  6,  and  7,  Figure  Identification,  Symbol 
Translation  and  Graphs,  in  which  significance  was  also  found  in  the 
original  study  by  Baldwin  and  Bailey  using  the  same  procedure.) 

Since  the  analyses  of  variance  resulted  in  significant  F  values 
for  Tests  4,  5,  6,  7,  8,  and  12,  further  analyses  were  conducted  to 
determine  the  significance  of  differences  between  pairs  of  m.eans.  The 
Scheffe  method  of  making  post-hoc  comparisons  (Scheffe,  1959)  was 
selected  for  use  in  this  study  because  it  is  applicable  in  situations 
where  a  preliminary  analysis  of  variance  has  shown  overall  signifi¬ 
cance.  In  addition,  the  Scheffe  test  has  no  requirement  that  post-hoc 
comparisons  be  independent;  it  can  be  used  to  make  any  and  all  com¬ 
parisons  of  interest  to  the  investigator.  It  was  used,  therefore,  to 
compare  all  pairs  of  means  in  the  analysis.  The  Scheffe  method  is 
mure  conservative  than  other  multiple  comparison  methods  with  regard 
to  Type-I  error,  and  leads  to  fewer  significant  differences.  Since  the 
.Scheffe  method  is  so  conservative,  this  study  followed  the 
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Table  I!.  Analysis  of  Variance  for  12  Tests 


Source  of 

Sum  of 

Mean 

F 

Test 

Variation 

Squares 

it  . 

Square 

Ratio 

Between  groups 

668,42 

2 

334.21 

Narrative  (50) 

Within  group! 

49407.90 

87 

567.91 

.  588 

Total 

50076. 32 

89 

562.66 

Between  group! 

310.40 

2 

155.20 

Narrative  (25) 

Within  group! 

16314.  SO 

87 

187. 52 

.828 

Total 

16624.90 

89 

186.80 

Short 

Between  groups 

399.  09 

2 

199.  54 

Paragraph 

Within  groups 

14404. 03 

87 

165.  56 

1.205 

Total 

14803. 12 

89 

166.33 

Figure 

Between  groups 

2895. 62 

2 

1447.81 

Identification 

Within  groups 

8944. 33 

87 

102.81 

14.083** 

Total 

1 1-839.  96 

89 

133.03 

Length 

Between  groups 

422. 49 

2 

211.24 

Estimation 

Within  groups 

4127.83 

87 

47.45 

4.452* 

ToUl 

4550.  32 

89 

51.  13 

Symbol 

Between  groups 

20376. 80 

2 

10188.40 

TrABilACIott 

Within  groups 

110856.80 

87 

1274.22 

7.996** 

ToUl 

131233.60 

89 

1474. 53 

Between  groups 

1197.07 

2 

598. 53 

Qr^hs 

Within  groups 

8620  93 

87 

99.09 

6.040** 

Total 

9818.  00 

89 

110.31 

Between  groups 

442.96 

2 

221.48 

Tables 

Within  groups 

2818.03 

87 

32.39 

6.838** 

ToUl 

3260.99 

89 

36.64 

Mochaaicftl 

Between  groups 

1059. 36 

2 

529.68 

D  rowing 

Within  groups 

34957. 13 

•7 

401.81 

1.318 

Total 

36016. 49 

89 

404.68 

Between  groins 

1.87 

2 

0.93 

Schematics 

Within  groups 

3073. 73 

87 

35.33 

0.026 

ToUl 

3075.  60 

89 

34.56 

Flow 

Between  groups 

138.  29 

2 

69.  14 

Diagrams 

Within 'groups 

3690. 17 

87 

42.42 

1. 630 

TeUi 

3828.  46 

89 

43.02 

Number 

Between  grot^s 

524.  47 

2 

262.23 

Verification 

Within  groups 

4463.  63 

37 

51.31 

5.  Ill** 

Total 

4988. 10 

89 

56.05 

*  SigBlflcaaee  beyond  the  .  OS  level 

**  Sl|Blfleaaee  beyond  the  .  01  level 
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reconinitindat ion  of  Ferguson  (1966)'  that  a  less  rigorous  le\'el  of 
S;ignificance  (.  10)  be  used.  A  brief  description  of  th'e  cpmputations 

I  '  f  ' 

invoh’ed  in  applying  the  Scheffe  test  are  prf^sented  in  Appendix  C. 

The  means  and  standard  deviations  for  each  group,  on  each 

:  ,  ’  *  '  I 

test,  are  presented  in  Tajble  III.  The  results  of  the  Scheffe  tests  for 

I 

significance  of  differences  between  these  mpans  are  presented  in 

''  '  '  '  ,  ‘  '  'I 

Table  IV',  arid  indicate  that  subjects  using  the  hardcopy  presentation 
performed  Significantly  better  than  subjects  rising  either  the  positive- 
image  ££  the  riegative-r  image  rinicrofiche  presentations  for  Test  4, 

Figure  Identification;  Test  5,  Length  Estimation;  Test  6,  Symbol 
Translation;  and  Test  12,  Number  V'erification.  In  addition,  test 
means  for  the  hardcopy  group  were  sign.ficantly ,high'er  than  test  meins 
for  the  negative- image  group  only  on  Test  7,  Graphs;  and  Test  8, 

Tables.  These  differences  were  significant  it  the  sugg'ested  .  10  level. 
None  of  the  differences  between  means  for  the  positive- image  versus 
the  negative- image  microfiche  groups  were  significant. 

«  .  I 

In  the  original  experiment,  Baldwin  and  Bailey,  using  t-tests 
to  determine  significant  inter-group  differences,  found  the  mean  score 
for  hirdcopy  was  s igiiificantly  higher  than  the  mean  score  for  either 
positive  or  negative  microfiche  for  Figure  Identification,  Symbol  Trans¬ 
lation,  and  Graphs. 

The  methodology  esIablishtKl  for  the  scoring  of  the  test 

>  ■  ■  ,  .  r  '  ‘  I 

exercises  (Le.,  Counting  the  r  mber  of  correct  response^  made  during 
established  time  limits)  did  not  allow  the  consideration  cf  speed  and 
accuracy  as  separate  factors .  A  post -hoc  analysis,  therefore,  was 
conducted  to  provide  some  insights  into  this  question.  In  this  analysis, 
the  ratio  of  corn-ct  responses  tt)  attempted  responses  was  computed 
for  eac  h  treatment  group,  on  i^ath  lest,  as  a  rough  measure  of  accuracy. 
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Table  III.  Test  Means  and  Standard  Deviations 


Table  IV.  Scheffe  Values  for  the  Twelve  Tests 


Test 

Hardcopy 

versus 

Positive 

Hardcopy 

versus 

Negative 

Positive 

versus 

Negative 

1. 

Narrative  (50) 

.4590 

1.115 

.  100 

2. 

Narrative  (25) 

.8190 

1.  548 

.  120 

3. 

Short  Paragraph 

.0007 

1.777 

1. 830 

4. 

Figure  Identification 

14. 5000* 

26. 080* 

1. 880 

5. 

Length  Estimation 

7.4800* 

5. 750* 

.  110 

6. 

Symbol  Translation 

9.  9000* 

13.770* 

.  310 

7. 

Graphs 

3.0200 

12. 070* 

3. 020 

8. 

Tables 

3.2000 

9.080* 

3.  630 

9. 

Mechanical  Drawing 

2.  1000 

1.840 

.  008 

10. 

Schematics 

.0287 

.  003 

.  002 

11. 

Flow  Diagrams 

.1150 

1.015 

1. 870 

12. 

Number  Verification 

8.4300* 

6. 850* 

.  080 

*  Significant  beyond  the  .  10  level  (4.47) 


The  results,  presented  as  percentages  in  Table  V,  indicate  that  students 
in  all  experimental  groups  were  extremely  accurate  on  all  but  three 
tests  (Short  Paragraph,  Length  Estimation  and  Schematics),  and  in 
these  three  tests,  the  groups  were  mutually  consistent.  This  indicates 
that  the  test  instruments  were  primarily  speed  tests;  that  is,  any 
answer  given  had  a  high  probability  of  being  correct.  Therefore,  the 
significant  differences  in  performance  indicated  in  Table  II  were  due  to 
differences  in  the  number  of  responses  attempted,  or  speed  effects. 

This  interpretation  is  supported  by  the  fact  that  there  were  no  real 
differences  among  the  three  groups  in  terms  of  accuracy  (as  defined 
above):  for  any  of  the  tests. 

To  test  the  hypothesis  that  students  of  varying  intelligence  are 
differentially  affected  by  the  mode  of  presentation,  subjects  were 
arbitrarily  placed  into  the  following  groups  based  on  their  AFQT  per¬ 
centile  scores:  Group  I.  80-100;  Group  II,  50-79;  and  Group  III, 

0-49.*  Twelve  one-way  analyses  of  variance  were  computed  for  each  of 
these  groups.  The  resultant  F  ratios,  as  well  as  the  means  and  stan¬ 
dard  deviations  for  the  test  exercises  in  each  of  the  three  AFQT  groups, 
are  presented  in  Tables  VI,  VII,  and  VIII.  The  analyses  indicate  that 
for  Group  I,  F  ratios  were  significant  beyond  the  .05  level  of  signi¬ 
ficance  for  Test  6,  Symbol  Translation,  and  Test  7,  Graphs;  and  beyond 
the  .01  level  for  Test  4,  Figure  Identification. 

In  Group  III,  F  ratios  were  found  to  be  significant  beyond  the 
.05  level  for  Test  2,  Narrative  (25-minutc),  and  Test  3,  Short 
Paragraph;  and  beyond  the  .01  level  for  Test  5,  Length  Estimation; 

*  AFQT  scores  were  unavailable  for  four  subjects,  resulting  in  an 
overall  sample  size  of  86  for  this  analysis. 
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Table  VI.  Test  Means  and  Standard  Deviations  for  AFQT  Scores  80-100 


Significant  beyond  the  .  10  level  (Z.47) 
Significant  beyond  the  .05  level  (3.32) 
Significant  beyond  the  .  01  level  (5.  39/ 


Table  VII.  Test  Means  and  Standard 


E 


None  of  the  F- values  were  significant  beyond  the  .  10  level 


Table  VIII,  Test  Means  and  Standard  Deviations  for  AFQT  Scores  0-49 


Significant  beyond  the  .01  level  ( 


Test  7,  Graphs;  and  Test  8,  Tables.  There  were  no  significant  dif¬ 
ferences  for  Group  II. 

Since  significant  differences  were  found  in  both  the  80-100  per¬ 
centile  groups  and  the  0-49  percentile  groups,  a  Scheffe  test  of  post-hoc 
comparisons  was  computed  for  all  pairs  of  means  in  these  groups.  The 
results,  presented  in  Tables  IX  and  X,  indicate  that  for  Group  III 
(0-49  AFQT  percentile  scores)  the  mean  score  for  subjects  using  the 
hardcopy  presentation  were  significantly  higher  than  the  mean  scores 
for  subjects  using  either  the  positive-image  or  the  negative- image 
fiche  presentations  for  Test  3,  Short  Paragraph;  Teat  5,  Length 
Estimation;  Test  7,  Graphs;  and  Test  8,  Tables.  The  hardcopy  group 
performed  significantly  better  than  the  negative- image  group  only,  on 
the  25-minute  narrative  exercise. 

For  Group  I  (80-100  AFQT  percentile  scores)  the  hardcopy 
mean  was  significantly  higher  than  both  the  positive  and  negative 
microfiche  means  for  Test  4,  Figure  Identification,  and  significantly 
higher  than  the  negative- image  means  for  Test  6,  Symbol  Translation; 
Test  7,  Graphs;  and  Test  11,  Flow  Diagrams.  All  of  the  differences 
reported  above  were  significant  beyond  the  .01  level.  Again,  none  of 
the  differences  between  means  for  positive  versus  negative- image 
presentations  were  significant  for  any  of  the  AFQT  groups  examined. 
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Table  IX.  Scheffe  Values  for  the  Twehe  Tests 
(80-100  AFQT  Scores) 


T  est 


Hardcopy 

versus 

Positive 


Hardcopy 
\ er sus 
Negative 


Pos  it  i  ve 
versus 
Negative 


1. 

Narrative  (50) 

.6974 

I — 

,  5138 

!  .0213 

2. 

Narrative  (25) 

.  6490 

1  .  7392 

.  2457 

3. 

Short  Paragraph 

.4108 

.  0002 

.  4428 

4. 

Figure  Identification 

6. 6700* 

15. 5770* 

1  .  6944 

5. 

Length  Estimation 

2.4750 

1 . 7297 

.  01^8 

6. 

Symbol  Translation 

3. 3000 

8. 5259* 

1 . 0982 

7. 

Graphs 

1 . 5000 

7.2421* 

2. 2048 

8. 

Tables 

.  096  3 

3.7293 

2.  5826 

9. 

Mechanical  Drawing 

.4485 

.  1699 

.  8310 

10. 

Schematics 

.0321 

.  0040 

.  0157 

11. 

Flow  Diagrams 

1.6144 

5. 7800* 

1. 2417 

12, 

Number  Verification 

1.2356 

.  6742 

.  1145 

*  Significant  beyond  the  .  10  level  (4.94) 


Table  X.  Scheffe  Values  for  the  Twelve  Tests 
(0-49  AFQT  Scores) 

Hardcopy  Hardcopy 

versus  versus 


Test  Positive  Negative 


1. 

Narrative  (50) 

4.4500 

2.3800 

2. 

Narrative  (25) 

4. 5800 

6. 0500# 

V  3. 

Short  Paragraph 

7.6100« 

6.0200# 

4. 

Figure  Identification 

1.4240 

4.2220 

5. 

Length  E.«timation 

1 1. 8300* 

14. 9700# 

6. 

Symbol  Translation 

4.4950 

2.4290 

7. 

Graphs 

15.0300* 

17. 4400# 

8. 

■  Tables 

5.6378* 

13. 6450# 

9. 

Mechanical  Drawing 

.  0167 

.  1021 

10. 

Schematic  s 

.  1381 

2.4700 

11. 

Flow  Diagrams 

3762 

.  0219 

12. 

Nun'iber  Verification 

.  — ,  ,  — ■  1 

2.4135 

2.  8138 

Significant  beyond  the  .  10  level  (5.40) 


Positive 

versus 

Negative 

.  8308 

.  0643 

.0651 

.  1372 

.  2228 

.  8302 

.  4496 

.  1945 

.  0127 

.6622 

.  5083 

.  0708 
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IV.  DISCUSSION  AND  CONCLUSIONS 

While  this  sturfy  was  conceived  as  a  replicsition  of  the  Baldwin 
and  Bailey  investigation,  it  was  executed  in  a  manner  consistent  with 
achievement  of  the  goals  of  the  larger  program:  Development  of  Micro¬ 
form  Materials  for  Use  in  Technical  Training.  Before  presenting  a 
discussion  of  the  study  results  in  the  context  of  the  larger  program, 
the  replication  aspects  will  be  developed. 

Replication 

Baldwin  and  Bailey's  work  was  an  attempt  to  develop  psycho¬ 
metric  instruments  of  known  reliability  and  content  validity  for  measur¬ 
ing  an  individual's  ability  to  process  each  of  several  types  of 
information  through  the  visual  modality.  These  instruments  were  then 
used  to  determine  the  influence  of  each  of  three  presentation  modes  on 
the  individual's  information  processing  ability. 

Their  development  of  the  test  instruments  was  only  partially 
successful  in  terms  of  the  original  design.  Three  test  instruments, 
evaluating  the  subjects'  ability  to  read  continuous  prose,  were  validated 
by  factor  analysis.  These  instruments  required  100  minutes  of  the 
total  162  minutes  allocated  for  all  tests.  The  remai.ning  nine  instru¬ 
ments,  taken  in  groups  of  three,  were  designed  to  measure  either 
comparative  visual  judgment  or  perceptual  speed.  These  instruments 
were  not  validated  under  the  Baldwin  and  Bailey ^  priori  groupings. 
However,  taken  as  a  single  group  of  nine,  these  instruments  did  have 
significant  factor  loadings  for  either  comparative  visual  judgment  or 
perceptual  speed.  The  content  and  validity  of  these  two  groupings  is 
very  important  in  understanding  the  replication  achieved  in  the  present 
study. 


Baldvy’in  and  fiaitey  found  no  significant  difference  in  perfor- 

'  •  I  i  <  I 

niance  using  the  narrative  materials  among  any  of  the  presentation 

'  I  ;  i 

modes  (Hardcopy,  Positive-flche,  Negative-fiche);  .This  result  vyas 
confirmed  by  the  present  study  in  terms  oT  the  overall  experimental 
results.  They  found  no  significant  difference  in  performance  across  all 
instruments  fdr  the  positive  versus  the  negative;  fiche, presentation; 

This  result  was  also  confirmed.  They  did,  however,  find  significant  dif 
ferences  between  fiyhe  and  hardcopy  performance  for  three  of  the  hine 

!  •  I  I 

•instruments  in  the  non-narrative  v  "ouping,  all  requiring  precise  visual 

.  I  ■  : 

discrimination.  This  result  was  confirmed,  but  three  additional  instru¬ 
ments  also  showed  significant  performance  differences  between  the 
hardcopy  apd  one  or  both  of  the,  fiche  presentations. 

In  general  then,  the  Baldwin  and  Bailey  results  were  replicated. 

/ 

Their  main  results  could  be  extended  to  a  different  environment,  a 

I  .  ^ 

different  time,  and  to  different  equipment.  However,  the  discovery  of 
the  additional  instruments  showing  significant  differences  in  perfor-r 
mahce  b.etween  hardcopy  and  the  filqi  presentations  in  the  present 
study  requires  elaboration.  :  , 

I 

Thr'ee  general  observations  must  be  madd  in  order  to  provide 
proper  context.  (1)  The  test  instruments  legislate  performance  dif¬ 
ferences  prinjarily  in  terms  of  speed.  Where  accuracy  does  enter 
the  performance  comparisons,  it  (accuracy)  is  independent  of  the 
presentation  mode  and  is  clearly  dependent  on  content  of  the  test 
instrument,  (see  Table  V'  )  (J)  W'hile  statistically  significant  dif- 

I 

ferences' in  performance  were  found  for  several  of  the  test  instruments, 

Baldwin  and  Ba-'ey  also  report  this  ol^serv  ation.  ' 


( 

there  is  clearly  no  fundannental  breakdown  in  comparative  perfor¬ 
mance  between  fiche  and  hardcopy  presentations.  (3)  The  performance 
of  a  complex  task,  using  a  reader  presentation,  is  not  strictly  equiva¬ 
lent  to  the  performance  of  the  same  task  using  hardcopy  only.  In  the 

■I  ,  • 

test  environitient,  the  reader  text  presentation  and  the  exercise 

I 

answer  sheet  could  not  be  spacially  related  in  the  same  way  as  could 
the  har|dcopy  text  presentations  and  answer  sheets.  This  split-function 
task  alone  causes  some  performance  decrement  with  a  film  presentation. 
It  is  feit  that  the  general  trend  toward  poorer  mean  scores  with  the 
fiche  presentations  reflects  this  decrement.  (See  Table  VII  for  trend 
details.)  The  importance  of  this  observation  can  be  seen  if  extremes 
are  cited.  In  the  narrative  (Test  I),  the  subjects  supplied  approximately 
one  answer  each  minute  for  50  minutes;  in  Test  6,  symbol  translation, 
the  subjects  supplied  approximately  12  answers  each  minute  for  10  min¬ 
utes.  All  the  tests  in  the  second  group  of  nine  have  strong  split- 
function  characteristics. 

Against  this  background,  there  are  two  methodological  dif¬ 
ferences  in  the  studies  that  might  explain  the  occurrence  of  significant 

I 

performance  differences  in  more  of  the  non-narrative  test  exercises. 
First,  in  Baldwin  and  Bailey's  study  only  three  test  sequences  were 
used,  with  the  narrative  material  always  presented  first.  In  the 
present  study,  the  test  exercises  were  presented  in  15  different  but 
counterbalanced  sequences  so  that  the  narrative  material  might  be  found 
at  the  beginning,  middle,  or  end  of  a  sequence.  Second,  the  Baldwin 
and  Bailey  study  apparently  tested  in  a  sequence  of  presentation  modes; 
in  the  present  study,  all  modes  were  test  concurrently.  It  is  felt  that 
these  procedural  differences  alone  are  sufficient  to  explain  why  three 
more  of  the  exercises  resulted  in  significant  performance  differences. 
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It  is  plausible  however,  to  hypothesize  that  this  "added 
sensitivity"  was  due  in  part  to  differences  in  the  distribution  of  AFQT 
scores  in  the  populations  sampled.  An  analysis  (discussed  below) 
indicated  that  different  intelligence  groups  vary  in  their  response  to 
the  method  used  to  present  technical  training  material.  Therefore, 
alterations  in  the  composition  of  populations  with  regard  to  intelligence 
groupings  will  affect  the  overall  sensitivity  of  the  test.  For  example, 
the  results  of  the  present  study  indicate  that  while  subjects  in  the 
middle  intelligence  range  are  insensitive  to  differences  in  the  mode  of 
presentation,  significant  differences  favoring  hardcopy  occurred  in  the 
higher  intelligence  group  on  the  same  three  exercises  which  resulted 
in  significant  differences  in  the  Baldwin  and  Bailey  work.  The  inclusion 
of  lower  intelligence  subjects  as  20%  of  the  population  in  the  present 
study  resulted  in  significant  differences  on  three  additional  test 
exercises.  It  is  hypothesized,  therefore,  that  the  distribution  of 
AFQT  scores  in  the  population  used  in  the  Baldwin  and  Bailey  study 
was  Skewed  to  omit  a  certain  number  of  subjects  in  the  0-49  range, 
thus  decreasing  the  sensitivity  of  their  testing  as  compared  to  the 
present  study. 

In  order  to  complete  the  comparative  aspects  of  the  two  studies, 
it  should  be  pointed  out  that  the  mean  scores  for  the  narrative  and 
short  paragraph  exercises  in  the  present  study  were  substantially 
higher  than  those  reported  in  the  original  study  for  the  same  tasks. 
These  discrepancies  are  possibly  due  to  differences  in  the  testing 
procedure  or  environmental  situation,  and  also  might  reflect  differences 
in  the  composition  of  the  sample  groups.  Information  concerning  such 
discrepancies,  however,  is  insufficient  to  make  further  comment. 
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Appendix  D  presents  a  table  of  means  and  standard  deviations 
for  the  twelve  tests  obtained  by  Baldwin  and  Bailey.  These  may  be 
compared  with  Table  III. 

Microform  Materials  for  Technical  Training 

The  results  of  the  study  have  direct  implication  for  the  develop¬ 
ment  of  microform  materials  to  be  used  in  training.  The  analysis 
dealing  with  the  question  of  whether  the  mode  of  presentation  differen¬ 
tially  affects  various  intelligence  groups,  is  particularly  useful.  For 
example,  all  of  the  significant  differences  found  between  student  per¬ 
formance  using  the  hardcopy  presentation  and  student  performance 
using  a  microfiche  presentation  occurred  in  the  higher  and  lower 
intelligence  groups.  No  significant  differences  were  found  on  any  of 
the  test  exercises  between  hardcopy  and  microfiche  for  the  inter¬ 
mediate  intelligence  group  (50-79  percentile) .  The  lower  intelligence 
group  (0-49  percentile)  was  affected  most  strongly  by  the  mode  of 
presentation.  Hardcopy  subjects  in  this  --oup  performed  significantly 
better  than  subjects  in  either  the  positi  *  negative  microfiche 
groups  on  four  of  the  twelve  test  exercises  (Short  Paragraph  Narrative, 
Length  Estimation,  Tables,  and  Graphs)  and  significantly  better  than 
the  negative  microfiche  group  on  the  Z5-minute  narrative  exercise. 

This  was  the  only  analysis  which  led  to  significant  differences  on  any 
of  the  narrative  materials.  These  differences  suggest  a  possible 
limitation  for  training  applications  for  students  in  lower  intelligence 
groups  using  microfiche  equipment.  Further  research,  using  a  larger 
sample  of  subjects  in  each  intelligence  classification  would  be  neces¬ 
sary  to  identify  these  limitations  more  adequately. 

The  performance  of  the  higher  intelligence  group  (80-100  per¬ 
centile)  also  was  affected  by  the  mode  of  presentation,  but  less 
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dramatically.  In  this  group,  performance  on  the  hardcopy  presentation 
was  significantly  better  than  performance  on  either  the  positive  or 
negative- image  microfiche  presentations  on  the  Figure  Identification 
exercise  and  better  than  the  negative-image  group  only  on  the  Symbol 
Translation,  Graphs,  and  Flow  Diagrams  exercises.  These  exercises 
are  very  much  dependent  on  the  recognition  of  individual  type  char¬ 
acters,  or  precise  visual  discrimination. 

While  the  recognition  of  this  performance-intelligence  link 
is  important,  one  very  positive  result  was  the  discovery  that  the 
intermediate  intelligence  group  (50-79  percentile)  could  both 
read  s.nd  perform  tasks  requiring  visual  judgement  and  perceptual 
speed  without  significant  perTormance  decrement  utilizing  the  reader 
presentations . 

The  post-hoc  analysis  which  operationally  defined  performance 
indicated  that  the  test  instruments  could  be  characterized  as  primarily 
speed  tests.  That  is,  the  significant  differences  encountered  in  the 
analyses  of  variance  and  the  Srheffe  tests  reflect  primarily  the  effects 
of  the  reader  presentation  on  the  speed  at  which  the  students  worked. 
This  result  indicates  that  accuracy  can  be  maintained  using  microforms 
and  does  not,  in  itself,  preclude  their  use  in  Air  Force  technical  train¬ 
ing  programs.  It  simply  means  that  where  appropriate,  more  time 
should  be  allowed  for  the  completion  of  split-function  tasks.  Further 
research  should  be  conducted,  however,  which  is  designed  specifically 
to  reflect  machine  effects  on  speed  and  accuracy  as  separate  factors. 

Finally,  comment  is  appropriate  relative  to  the  question  of 
image  polarity.  The  use  of  the  Scheffe  test  in  the  present  study  allowed 
the  comparison  of  all  pairj  of  means  in  the  analysis  since  it  has  no 
requi r eme.nt  that  the  post-hoc  comparisons  be  independent.  As  in  the 
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previous  study,  no  significant  performance  differences  were  found 
between  the  positive-image  and  the  negative- image  fiche  presentations 
on  any  of  the  twelve  test  exercises.  However,  a  comparison  of  the 
hardcopy  means  with  each  of  the  microform  means  indicated  that  on 
two  of  the  test  exercises  (tables  and  graphs),  the  means  for  the  hard¬ 
copy  group  were  significantly  higher  than  the  means  for  the  negative- 
image  group  but  not  significantly  different  from  the  means  of  the 
positive-image  group.  This  fifiding  documents  a  general  tendency  over 
all  test  instruments  for  the  negative-image  group  to  be  less  effective 
in  the  performance  of  the  tasks  than  the  positive- image  group. 

Since  the  factor  analysis  conducted  by  Baldwin  and  Bailey  indi¬ 
cated  that  nine  of  the  twelve  test  exercises  had  high  loadings  on  the 
comparative  visual  judgement  and  perceptual  speed  factors,  the  above 
results  also  comment  on  the  question  of  v'isibility  versus  readability 
discussed  earlier.  Given  the  split-function  complexity  added  to  the 
tasks  by  using  any  reader  presentation,  the  above  results  appear  to 
indicate  that  positive-image  microforms  are  better  able  to  meet  the 
visibility  (individual  character  recognition)  requirements  than  are 
negative -image  microforms.  This  type  of  interpretation  is  supported 
by  the  performance  of  the  higher  intelligence  group  (80-100  percentile) 
which  had  particular  difficulty  with  the  negative -image  presentation 
(see  Tables  VI  and  IX).  However,  the  positive-image  presentation 
resulted  in  the  poorest  performance  by  subjects  in  the  lower  intel¬ 
ligence  group  (0-49  percentile).  This  ambiguity  is  perhaps  partially 
explained  by  differential  effects  of  the  negative-image  as  a  novel 
approach  among  various  intelligence  groups  or  by  differences  in 
previous  experience.  Further  research  should  be  conducted  to  clarify 
the  issue  of  image  polarity  by  examining  the  role  of  image  degradations 
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(or  visibility  difl'erontes)  directly  as  they  affect  student  performance 
over  various  presentation  modes.  By  testing  with  successively  poorer 
visibility,  the  interaction  between  image  degradation  and  image  polarity 
could  be  documented. 
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APPENDIX  A 


TEST  INSTRUCTIONS  AND  SAMPLE  ITEMS 


The  following  pages  consist  of  reading  matter  which  you 
will  be  asked  to  read  for  both  speed  and  accuracy.  On  each  page 
three  words  have  been  eliminated  and  replaced  by  blanks.  Your 
task  will  be  to  read  the  material  and  supply  the  missing  words. 

Read  the  following  example  and  identify  the  missing  word. 

Survivors  must  know  how  to  exploit  to  their  advantage 
the  meat  of  game  and  fish,  how  to  prepare  plant  food  for 
eating  and  above  all  how  to  accomplish  this  with  the  least 
effort  and  physical  exertion.  Many  men  have  died  from 
starvation  because  they  have  failed  to  take  full  advantage 
of  a  game  carcass  or  the  plant _ 1 _  available. 

In  the  practice  example  the  word  "food"  was  eliminated. 

You  would  therefore  write  "food"  on  the  separate  answer  sheet  in 
the  space  corresponding  to  the  number  of  the  blank. 

When  you  are  told  to  begin,  turn  the  page  immediately  and 
begin  to  work.  You  will  be  allowed  50  minutes  for  this  exercise. 

You  are  not  expected  to  complete  the  test.  Do  not  spend  too  much 
time  on  any  one  word,  but  do  not  hurry.  Attempt  to  read  at  a  steady 
pace. 


No  words  are  eliminated  on  the  first  page  to  allow  you  to 
familiarize  yourself  with  the  material.  Beginning  on  page  two,  record 
on  the  separate  answer  sheet  the  missing  word  corresponding  to  the 
number  in  the  blank.  Please  do  not  mark  on  this  test  booklet. 

TESTS  1  AND  2.  NARRATIVE 
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The  following  exercises  consist  of  short  paragraphs  in  which 
one  word  has  been  changed.  Your  task  will  be  to  read  the  paragraphs 
and  identify  the  word  which  is  not  consistent  with  the  meaning  of  the 
paragraph.  Read  the  following  practice  example  and  identify  the 
inappropriate  word. 

Survivors  must  know  how  to  exploit  to  their  advantage  the 
meat  of  game  and  fish,  how  to  prepare  plant  food  for  eating  and 
above  all  how  to  accomplish  this  with  the  least  effort  and  physical 
exertion.  Many  men  have  died  from  drowning  because  they  failed 
to  take  full  advantage  of  a  game  carcass  or  the  plant  food  available. 

In  the  practice  example  the  word  "drowning"  does  not  agree  with 
the  context  of  the  rest  of  the  paragraph.  You  would  therefore  write  the 
word  "drowning"  on  the  separate  answer  sheet  to  indicate  the  incorrect 
word. 


Now  read  the  following  additional  practice  examples.  This  time 
write  the  incorrect  word  on  the  separate  answer  sheet. 

1.  The  sea  of  the  Arctic  Basin  and  the  shores  adjoining  it 
have  few  fish  or  shellfish  useful  for  survival  purposes.  The 
inland  lakes  and  rivers  of  the  surrounding  coastal  tundra, 
however,  generally  have  plenty  of  animals  which  are  easy  to 
catch  during  the  warmer  season. 

2.  If  mussels  are  the  only  available  food,  select  only  those 
in  deep  inlets  far  from  the  coast.  Remove  the  dark  intestinal 
gland  after  eating. 

TEST  3.  NARRATIVE  -  SHORT  PARAGRAPH 
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This  is  a  test  of  your  ability  to  match  a  given  object.  At  the  left  of 
each  row  is  an  object.  To  the  right  are  five  test  objects,  one  of  which 
matches  the  object  at  the  left.  Look  at  the  example  below: 


<  (S)  O  ®  ®  #  ® 

A.  8.  C.  D.  E. 


The  third  test  object  (C)  is  the  correct  response,  because  it  is  the 
same  as  the  object  at  the  left. 

Now  practice  on  the  problems  below.  Ciri.^.  the  letter  on  the  separate 
answer  sheet  for  the  object  that  matches  the  one  at  the  left.  Make  no  marks 
on  the  test  booklet. 

*  ^  ^  ^  @  ^  O 

A.  8.  C.  0.  E. 

n 

A.  d.  C.  D.  E. 

®  ©  ®  ® 

•i  a fl see 

A.  8.  C.  D.  E. 

The  correct  responses  for  the  practice  exercises  above  should  be: 

2  =  B:  3  =  E;  4  =  D;  and  5  =  B. 

When  you  are  told  to  begin,  turn  the  page  and  immediately  begin  to 

work.  You  will  have _  minutes  for  each  of  the  two  exercises  for  this  part. 

Work  as  quickly  as  you  can  without  sacrificing  accuracy.  Each  exercise  has 
two  pages.  If  you  finish  Exercise  1,  STOP.  Please  do  not  go  to  Exercise  2 
until  you  are  asked  to  do  so. 

TEST  4.  FIGURE  IDENl.FICATION 


In  this  test  you  are  to  examine  three  lines  or  roads  that  connect  pairs 
of  points  (•)  and  select  the  line  that  is  the  shortest.  The  top  or  high  road 
is  -A;  the  middle  road  is  B;  and  the  bottom  or  low  road  is  C.  Look  at  the 
two  sample  problems  below.  On  the  separate  answer  sheet  mark  the 
shortest  road  by  circling  the  correct  letter  under  each  problem.  Make 
no  marks  on  (he  test  booklet. 


A  B  C 


In  the  examples  above,  A  is  the  answer  to  problem  I;  and  B  is  the 
answer  to  problem  II. 

When  you  are  told  to  begin,  turn  the  page  and  immediately  begin  to 

work.  You  will  have _  minutes  for  each  of  the  two  exercises  for  this  part. 

Work  as  quickly  as  you  can  without  sacrificing  accuracy.  Each  exercise  has 
one  page.  If  you  finish  Exercise  1,  STOP.  Please  do  not  go  to  Exercise  2 
until  you  are  asked  to  do  so. 


TEST  5,  LENGTH  ESTIMATION 
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Tjiis  is  a  test  of  your  ability  to  translate  symbols  into  alphabetic 
characters.  Following  is  a  partial  li^t  of  typewriter  characters  (symbols) 
that  correspond  to  letters  of  the  alphabet.  ' 


SYMBOL 

LETTER 

SmSQL 

LETTER 

] 

a' 

% 

F 

I 

B 

t 

G 

«  ‘ 

C 

<  & 

H 

1 

D 

• 

1 

$ 

E 

) ' 

J 

'  In  this  exercise  you  will  be  required  to  write  in  the  blanks  the  alpha¬ 
betic  character  that  corresponds  to  the  given  symbol.  The  answer  will 
consist  of  jumbled  letters  rather  than  actual  words.  Refer  to  the  above  list 
of  cha,racters  and  complete  the  following  practice  examples.  Record  your 
answers  on  the  separate  answer  sheet.  Mak^  no  marks, on  the  test  booklet. 

1.  •  &  *  )  % _ 

•  .  '  '  ^  ' 

2.  !  1  $  t  _ 

3.  [  %  ®  —  f . “• 

I  ■  I  . 

The  correct  responses  for  the  examples  above  are;  1  =  CHIJF; 

2  =  DAEG;  and  3  =  BFCI. 

When  you  are  told  to  begin,  turn  the  puge  and  immediately  begin  to 

work.  There  is  only  one  page  to  this  part.  You  will  have _ minutes  to 

complete  the  exercise.  Work  as  quickly  as  you  can  without  sacrificing 
accuracy.  If  you  finish  the  exercise,  .STOP. 


TEST  6.  SYMBOL  TRANSLATION 
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This  is  a  test  of  your  speed  and  accuracy  in  reading  a  graph.  The  graph 
illustrated  below  contains  four  curves  —  A,  B,  C,  and  D.  These  curves  plot 
the  relationship  of  temperature  to  time  under  certain  experimental  conditions. 
Minutes  are  marked  on  the  lower  (horizontal)  edge  of  the  graph  and  temper¬ 
atures  are  shown  at  the  left  (vertical)  edge.  Study  the  example  below. 


0.  S  10  15  20  2S 

NUMBER  OF  MINUTES 

In  this  exercise,  the  minutes  will  be  given.  You  are  to  find  the  temper¬ 
ature,  corresponding  to  the  given  number  of  minutes,  for  each  of  the  four 
curves. 

Procedure:  Locate  the  desired  number  of  minutes  on  the  horizontal 
scale.  Follow  the  vertical  line  up  from  that  point  to  where  it  crosses  Curve 
A.  Then  read  the  temperature  from  the  scale  at  the  left.  Repeat  the  pro¬ 
cedure  for  each  of  the  other  three  curves.  Round  your  answer  off  to  the 
nearest  whole  member.  Now,  complete  the  following  practice  exercises. 
Record  your  answers  on  the  separate  answer  sheet. 

Minutes  Curve  A  Curve  B  Curve  C  Curve  D 

1.  18  _  _  _  _ 

2.  7  _  _  _  _ 

The  correct  responses  for  the  exercises  above  are:  1.  =  10,  5,  16,  10; 
and,  2.  =  b.  10,  13,  17. 

When  you  are  told  to  begin,  turn  the  page  and  immediately  begin  to 

work.  There  is  only  one  page  to  this  part.  You  will  have _  minutes  to 

complete  the  exercise.  Work  as  quickly  as  you  can  without  sacrificing 
accuracy.  If  you  finish  the  ex.ircise,  STOP. 


TEST  7,  GRAPHS 
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In  this  test  you  will  be  required  to  locate  and  record  values  found  on  a 
table.  The  table  below  indicates  drill  sizes  and  their  corresponding  decimal 
equivalents.  Note  that  the  drill  sizes  may  be  represented  as  letters,  numbers 
or  fractions. 


SIZE 

DECIMAL 

EQUIVALENT 

1/2 

0.500 

Y 

0.404 

X 

0.397 

25/64 

0.3906 

2 

0.221 

130 

0.185 

You  will  be  required  to  furnish  the  decimal  equivalent  for  each  of  the 
drill  sizes  indicated.  Your  responses  will  be  recorded  on  the  s  oarate 
answer  sheet.  Refer  to  the  above  table  and  complete  the  following  examples. 


1.  2S/64 

2.  2 

3.  Y 


In  the  examples  above  the  correct  responses  are;  1.  =  0.  3906;  2.  = 
0.221;  and,  3.  =  0.404. 

When  you  are  told  to  begin,  turn  the  page  and  immediately  begin  to 

work.  There  is  only  one  page  to  this  part.  You  will  have _  minutes  to 

complete  the  exercise.  Work  as  quickly  as  you  c«i.  without  sacrificing 
accuracy.  If  you  finish  the  exercise,  STOP. 

TEST  8.  TABLES 
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In  this  test  you  will  be  required  to  locate  lines  and  surfaces  on  three 
separate  views  of  a  drawing  which  correspond  to  lines  and  surfaces  on  a 
pictorial  view  of  the  same  object.  In  Figure  1.  below  you  will  observe  a 
three  dimensional  view  (pictorial)  of  a  box.  The  box  is  hinged  on  three  sides 
so  that  it  may  be  spread  flat.  Figure  2.  is  a  drawing  of  the  same  box  with 
the  top  raised  and  the  side  swung  around  to  the  front. 


TOF 

1 

FRONT 

' 

1 

SIDE 

1 

FIG.  2 


The  drawings  which  follow  will  utilize  this  same  format.  You  will 
see  a  pictorial  view  of  an  object.  Then,  th3  object  will  be  shown  as  it 
would  appear  if  it  were  hinged  and  spread  flat  on  the  page.  Are  there  any 
questions  related  to  the  first  example? 

The  next  drawing  is  like  the  one  shown  above  except  that  a  part  of  the 
solid  block  is  cut  away.  The  same  object  is  drawn  in  three  views  except 
that  the  "hinges"  are  omitted  and  the  views  are  separated  slightly  to  niake 
it  easier  to  visualize.  Study  the  example  on  the  following  page  to  make  sure 
the  views  are  clearly  understood.  Do  not,  at  this  point,  be  concerned  about 
the  numbers  and  letters  on  the  various  views. 


TEST  9.  mechanical  DRAWING 
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This  is  a  test  in  which  you  are  to  choose  a  correct  path  from  among 
several  choices.  In  the  picture  below  is  a  box  with  dots  marked  S  and  F. 
S  is  the  starting  point  and  F  is  the  finish.  You  are  to  follow  the  line  from 
S,  through  the  circle  at  the  top  of  the  picture  and  back  to  F. 


In  the  problems  in  this  test  there  will  be  five  such  boxes.  Only  one 
box  will  have  a  line  from  the  S,  through  the  circle,  and  back  to  the  F  in  the 
same  box.  Dots  on  the  lines  show  the  only  places  where  connections  can 
be  made  between  lines.  If  lines  meet  or  cross  where  there  is  no  dots,  there 
is  no  connection  between  the  lines.  Now  attempt  the  follovdng  example  by 
identijfying  the  box  which  has  the  line  through  the  circle.  Make  no  marks  on 
the  test  booklet  or  answer  sheet. 


0 


iHifffiiftH 


A. 


C. 


D. 


E. 


The  first  box  is  the  one  which  hat  the  line  from  S,  through  the  circle, 
and  back  to  F.  The  apace  lettered  A  would  therefore  have  been  circled  on 
the  answer  sheet. 

Each  diagram  in  the  test  has  only  one  box  which  has  a  line  through 
the  circle  and  back  to  the  F.  Some  lines  are  wrong  because  they  lead  to 
a  dead  end.  Some  lines  are  wrong  because  they  come  back  to  the  box  with¬ 
out  going  through  the  circle.  Some  lines  are  'rong  because  they  lead  to 
other  boxes  that  do  not  have  lines  going  through  the  circle. 


TEST  10,  SCHEMATICS 


42 


This  is  a  test  to  find  the  shortest  route  between  two  places  as  quickly 
as  possible.  The  drawing  below  is  a  map  of  a  city.  The  dark  lines  are 
streets.  The  circles  are  road-blocks,  and  you  cannot  pass  at  the  places 
where  there  are  circles.  The  numbered  squares  are  buildings.  You  are  to 
find  the  shortest  route  between  two  lettered  points.  The  number  on  the  build¬ 
ing  passed  is  your  answer. 

Rules:  1.  The  shortest  route  will  always  pass  along  the  side  of  one  and 
only  one  of  the  numbered  buildings. 

2.  A  building  is  not  considered  as  having  been  passed  if  a  route 
passes  only  a  corner  and  not  a  side. 

3.  The  same  numbered  building  may  be  used  on  more  than  one  route. 

Look  at  the  sample  map  below.  Practice  by  finding  the  shortest  route 
between  the  various  points  listed  at  the  right  of  the  map.  Your  answer  is  to 
be  recorded  on  the  separate  answer  sheet.  The  first  problem  has  been  marked 
correctly. 

The  shortest  Passes 

route  from:  building: 

I  1.  A  to  Z  I 

2.  I  to  8  _ 

J 

3.  P  to  J  _ 

K  V  to  K  _ 

5.  0  to  P 
L 

6.  0  to  M  _ 

7.  D  to  Q  _ 

8.  P  to  T  _ 

The  answers  to  the  other  practice  problems  are  as  follows:  2  passes  5; 

3  passes  3;  4  passes  2;  5  passes  4;  6  passes  4;  7  passes  6;  and  8  passes  5. 

TEST  11,  FLOW  DIAGRAMS 
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This  is  a  test  to  find  out  how  quickly  you  can  compare  two  numbers  and 
decide  whether  or  not  they  are  the  same<.  If  the  numbers  are  the  same,  go 
on  to  the  next  pair,  making  no  mark  on  the  answer  sheet.  If  the  numbers  are 
not  the  same,  circle  the  number  on  the  separate  answer  sheet  corresponding 
to  the  nvimber  at  the  left  of  the  incorrect  pair.  Now,  complete  the  following 
practice  examples.  Make  no  marks  on  the  test  booklet. 


1. 

669 - 

669 

11. 

7343801 - 

7343801 

2. 

73846 - 

73866 

12. 

18824 - 

18824 

3. 

1624 - 

1624 

13. 

706216831 - 

795216831 

4. 

438 - 

436 

14. 

971 - 

•971 

S. 

4821466 - 

4821469 

16. 

446014721 - 

446014721 

6. 

668331 - 

666331 

16. 

6173869 - 

5172869 

7. 

11663 - 

11662 

17. 

643001717 - 

6430017 

8. 

617439428 - 

617439428 

ia 

518198406 - 

■518168046 

9. 

1860439 - 

1860439 

19. 

66179 - 

-56007 

10, 

90776106 - 

90716106 

20. 

63216067 - 

•63216057 

The  incorrect  pairs  in  the  practice  examples  are  as  follows:  2,  4,  5, 

6,  7,  10,  13,  16,  17,  18,  19,  and  20.  These  numbers  should  have  been 
circled  on  the  answer  sheet. 

When  you  are  told  to  begin,  tuii  n  the  page  and  immediately  begin  to 

work.  You  will  have _ minutes  for  each  of  the  ^o  exercises  for  this  part. 

Work  as  quickly  as  you  can  without  sacrificing  accuracy.  Each  exercise 
has  one  page.  If  you  finish  Exercise  1,  STOP.  Please  do  not  go  to  Exercise 
2  until  you  are  asked  to  do  so. 


TEST  12,  NUMBER  VERIFICATION 
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ort  Paragraph  (25)  I  Ik.  Symbol  Translation 
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Symbol  Translation  (10)  |  12.  Short 


ORDERS  OF  PRESENTATION  (Continued) 
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Symbol  Translation 
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APPENDIX  C 


COMPUTING  THE  SCHEFFE  METHOD 
OF  POST-HOC  COMPARISONS 

Tho  following  method  of  making  selected  a  posteriori  and  com¬ 
plete  sets  of  comparisons  among  experimental  group  means  was  devel 
oped  by  Scheffe  (5).  A  simple  means  of  applying  this  method  is 
suggested  by  Furguson  (4)  according  to  the  following  procedure. 

Step  1.  Calculate  F  ratios  using  the  following  formula; 

P  3 ^  ,  ■  (li  -  x^)^ 

Sw^/nj  +  Sw^/nz  Sw^(ni  +  n2)/nin2 

where  Sw^  equals  the  within-group  variance,  and  n  equals  the  sample 
sizt.  . 

Step  Z.  Consult  a  table  of  F  and  obtain  the  value  of  P'  required 
for  significance  at  the  desired  level  for  dfj  =  k-1  and  df2  =  N-k. 

Step  3.  Calculate  a  quantity  F',  which  is  k-1  times  the  F 
required  for  significance  at  the  desired  level;  that  is,  F'  =  (k-l)F. 

Step  4.  Compare  the  values  F  and  F'.  F  r  any  difference  to 
be  significant  at  the  desired  level,  p'  must  be  greater  than  or  equal  to 


Appendix  D.  Test  Means  and  Standard  Deviations  in  the 
Baldwin  and  Bailey  Study 

Offset  Copy  Positive  Negative 


Test  No. 

N 

=45 

N: 

=43 

N: 

=45 

X 

S.  D. 

X 

S.D. 

Ti 

S.D. 

.1. 

Narrative  (50  min.)  • 

37 

15.2 

38 

- 1 

19.  1 

40 

20.  7 

•  2. 

Narrative  (25  min.) 

19 

7.  5 

19 

8.7 

20 

11.2 

'  3. 

Narrative-Short  Paragraph 

27 

11.8 

27 

11.7 

30 

13.3 

4. 

Figure  Identification 

61 

12.  5 

54 

9.0 

52 

8,  7 

5. 

Length  Estimation 

30 

6.0 

28 

8.8 

27 

6.  2 

6. 

Symbol  Translation 

141 

28.4 

114 

28.3 

11? 

30.  7 

7. 

Graphs 

34 

10.8 

28 

9.6 

29 

9.9 

8, 

Tables 

17 

5.7 

16 

5.7 

15 

6.0 

9. 

Ivlechanical  Drawing 

27 

16.4 

33 

18.  3 

36 

20.4 

10. 

Schematics 

10 

5.  7 

i 

11 

5.  7 

12 

6.  4 

11. 

Flow  Diagrams 

19 

5.  5 

18 

4.  1 

20 

5.  1 

12. 

Number  Verification 

30 

6.9 

29 

6.  9 

29 

7.  3 

*  Tests  in  which  mean  scores  were  substantially  lower  in  the  Baldwin  and 
Bailey  study  than  in  the  present  study  (see  Table  III) 
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